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Abstract 

Stereotype threat — a situational context in which individuals are concerned about 
confirming a negative stereotype — has been frequently shown to test performance, with one 
hypothesized mechanism being that cognitive resources are temporarily coopted by intrusive 
thoughts and worries, leading individuals to underperform despite high content knowledge and 
ability (see Schmaeder & Beilock, 2012). We test here whether stereotype threat may also impact 
initial student learning and knowledge formation when experienced prior to instruction. 
Predominantly African American 5th grade students provided either their race or the date before a 
videotaped, conceptually demanding mathematics lesson. Students who gave their race retained 
less learning over time, enjoyed the lesson less, reported a diminished desire to learn more, and 
were less likely to choose to engage in an optional math activity. The detrimental impact was 
greatest among students with high baseline cognitive resources. While stereotype threat has been 
well documented to harm test performance, the finding that effects extend to initial learning 
suggests that stereotype threat’s contribution to achievement gaps may be greatly 


underestimated. 


Stereotype Threat Effects on Learning from a Cognitively Demanding Mathematics Lesson 


In the context of an ever-increasing emphasis on school accountability and standardized 
test performance, many students experience a great deal of pressure at school, which can produce 
worry about how their performance will be evaluated (Triplett & Barksdale, 2005; Watson, 
Johanson, & Dankiw, 2014). Performance pressure is known to impact test performance, leading 
some students to underperform relative to their knowledge base, or "choke" (see Beilock & Carr, 
2005; Beilock, 2008; Nguyen & Ryan, 2008). While motivation may be increased by 
performance pressure, performance on cognitively taxing tests that require reasoning or 
representational manipulation may be impaired (see Maloney, Sattizahn & Beilock, 2014). 

Coupled with this general evaluative pressure, everyday experiences of identity 
judgments can be frequent and related to overall achievement (Wong, Eccles & Sameroff, 2003). 
Thus students of color may be also susceptible to experiencing stereotype threat both during 
testing events and in everyday learning contexts (Larnell, Boston, & Bragelman, 2014; Nasir, 
2009, 2012; Steele & Aronson, 1995). Stereotype threat is the phenomenon in which fear of 
being judged through the lens of a negative stereotype results in intrusive thoughts and worries 
that tax cognitive resources (Schmaeder & Beilock, 2012). Extensive research in adults (for 
review see Nguyen & Ryan, 2008) and growing work with children (e.g. McKown & Strambler, 
2009; Neuburger et al., 2015; Wasserberg, 2014) documents that when a self-relevant negative 
stereotype is made salient before a test, performance suffers. 

Stereotype threat is most often invoked by giving participants a prompt before a test that 
includes some combination of increasing identity salience, such as by asking participants to 


report their race or presenting the study as being concerned with how individual differences 


influence performance, and raising the stakes of performance, such as presenting the task as 
diagnostic of ability. For example, in Steele & Aronson’s (1995) seminal study, stereotype threat 
was invoked among African American adult participants by describing the study as “being 
concerned with ‘various personal factors involved in performance’” and as diagnostic of 
participants’ ability. In contrast, in the control condition, the test was described as simply aimed 
at better understanding factors involved in problem solving. African American participants who 
received the former instructions underperformed relative to African American participants who 
received the control prompt and relative to white participants who received either prompt. 
Studies have shown that children begin to become aware of negative racial stereotypes as early 
as 6 years of age, with most children being aware of broadly held racial stereotypes by age 10 
(McKown &Weinstein, 2003; McKown, 2004), and that, like adults, stereotype-aware children 
can be susceptible to prompts that invoke stereotype threat by increasing identity salience and 
performance consequences (McKown & Strambler, 2009; Wasserberg, 2014). In school-based 
studies with children, stereotype threat has been invoked by presenting a task as being diagnostic 
of ability (e.g. “a good way of testing how good you are at different kinds of school problems”, 
McKown & Strambler, 2009) or as being predictive of performance on an upcoming 


standardized test and asking students to provide their race (Wasserberg, 2014). 


Effects of Stereotype Threat on Learning 

Despite this broad literature, much less is known about whether stereotype threat and 
pressure may also impact initial learning. An individual experiencing stereotype threat may not 
only under-demonstrate her knowledge on a test that requires complex cognition, but worry 


ideation associated with stereotype threat could also interfere with her engagement in higher 


cognition during initial learning. In this case, not only would the student’s final test performance 
be impaired, but her initial learning and knowledge formation would be harmed such that content 
from the lesson was not even available to her at a later point, when the threat of fulfilling a 
stereotype was no longer salient. This could have potentially systemic effects in a discipline such 
as mathematics, where the curriculum builds on previously learned material, such that if a 
student failed to fully understand one content area, s/he may be at a disadvantage for learning the 
subsequent step, with ever increasing consequences. 

Considering the mechanisms underpinning the relationship between stereotype threat and 
test performance clarifies why the consequences of pressure on learning, not just on testing, may 
be an essential part of closing achievement gaps in schooling. Executive function (EF) load is 
one mechanism that has received much support as an explanation for why stereotype threat may 
decrease test performance. EF resources may be co-opted for negative ideation about test 
performance, with looping thoughts such as “I don’t want to fail this test, I don’t want to fail this 
test” engaging the same resources that would instead be more productively used to engage with 
the test material (see Schmaeder & Beilock, 2012). Test performance for youth and adults under 
stereotype threat or performance pressure is most affected on challenging, cognitively- 
demanding problems, (for review, see Maloney, Sattizahn & Beilock, 2014). Stereotype threat 
effects in particular have been shown to be especially pronounced on cognitively demanding 
comparison problems that require suppression of a prepotent response, possibly because 
motivation to perform well made the prepotent response stronger, and EF resources were already 
taxed so less available to inhibit that response (Davies et al. 2016). 

One might assume based on these patterns that having high baseline EF resources would 


serve as a protective factor against stereotype threat, but in contrast, it is often the highest EF 


participants who show the largest effects of stereotype threat on test performance (for reviews 
see Beilock, 2008; Maloney, Schaeffer & Beilock, 2013). Much of this work has been conducted 
in mathematics, and may be because these are the participants who are most used to engaging 
high levels of EF resources on challenging tasks (e.g. using strategies that require EF), so they 
are therefore most likely to have to change their test-taking strategies (e.g. Beilock & Carr, 2005; 
Beilock & Decaro, 2007). 

A second way that stereotype threat may impact performance is that stereotype threat 
during testing can negatively impact student interest in and identification with the stereotyped 
domain (Smith, Sansone & White, 2007; Woodcock et. al, 2012). This could have longer-term 
consequences than solely test performance, since decreased engagement and identification with a 
domain could impact future school and employment trajectories including academic coursework 
selection or career goals. 

The current study examined how invoking stereotype threat and performance pressure 
prior to a conceptually demanding mathematics lesson impacted African American 5th grade 
students. We examined impacts on learning as well as on situational interest and motivation to 
engage in non-required math activities. Additionally, we tested whether the impact of stereotype 
threat and performance pressure experienced while learning was moderated by individual 
differences in EF, as has been shown to be the case for stereotype threat experienced during 
testing (Beilock, 2008). 

The lesson’s objective was to teach students to compare ratios with different 
denominators. It centered on a comparison between a correct strategy (lowest common multiple) 
and a misconception (subtraction). The act of comparing and contrasting solutions, including 


misconceptions, is a recommended educational practice that has been shown to promote deep 


learning (Durkin & Rittle-Johnson, 2012; Richland & McDonough, 2010; Rittle-Johnson & Star, 
2007). At the same time, comparing correct and incorrect solution strategies places high 
demands on student’s cognitive resources, as students must be able to learn from the 
misconception discussion, but ultimately inhibit it as a prepotent response, and encode the 
correct strategy (Zaitchik, Iqbal, & Carey, 2014). Just as performance on challenging test items is 
most harmed during experiences of stereotype threat or performance pressure, this type of high 
quality- high demand learning could be especially compromised by situational stressors that tax 
cognitive resources. 
Method 

Participants 

Study participants were 135 5th grade students drawn from two K-6 charter schools. All 
participants were members of minority groups that are negatively stereotyped academically, with 
the majority of students self-reporting their race/ethnicity to be Black/African American. 
Participants were nearly evenly split by gender with slightly more girls (Control condition: 33 
girls, 31 boys; Stereotype Threat (ST) condition: 37 girls, 34 boys). The distribution of 
participants’ race/ ethnicity identification was comparable across conditions. 

More detailed information on study participants can be found in the supplementary 
materials. 
Materials and Procedure 

Design. Procedures were administered during three visits over a two-week period 
at each school using a pretest, lesson and immediate posttest, delayed posttest design. 
Participants were randomly assigned within each classroom to either the Learning 


under a Stereotype Threat (ST) condition or Control condition to minimize variability 


across schools and teachers. In all cases the primary experimenter was a white female and all but 


one of the classroom teachers were also white females. However, random assignment of 


participants to conditions within classrooms ensured that there were no differences in ethnic 


backgrounds of experimenters or teachers between experimental groups. 


At Visit 1, students completed a group-administered pretest to assess their 
starting understanding of ratio. This assessment, as well as the immediate and 
delayed posttests, measured conceptual and procedural understanding of ratio 
as well as misconception usage- the frequency with which students incorrectly 
made use of subtraction to attempt to solve problems requiring use of ratio 
concept (for test properties, see Begolli & Richland, 2016). 

At Visit 2, students interacted individually with a videotaped lesson on ratio, 
which centered on a comparison between two common solution strategies for 
solving ratio problems — one a frequent misconception (Subtraction) and one a 
correct solution (Least Common Multiple, or LCM). Greater details on the lesson 
and math assessments are provided in the supplementary materials. 

Stereotype threat was manipulated prior to the video lesson, before learning. 
Specifically, at the start of the video lesson, students in the ST condition viewed a video 
screen in which the following prompt was visible and read aloud: “Thank you for being 
part of this study. Please turn to page 2 in your packet and fill in your race. Professors at 
the University of Chicago are very interested in knowing about you and how you perform 
on the test after the lesson. Your information is very important to us, because we want to 
learn how to best help kids like you learn math.” Students in the Control condition 


viewed a video screen in which the following prompt was visible and read aloud: “Thank 


you for being part of this activity. Please turn to page 2 in your packet and write today’s 
date. We’re glad that you are doing this activity because it will help us learn about some 
of the best ways to teach kids math.” In both conditions, the prompt was visible on the 
screen for 30 seconds. With the exception of this introduction, the video was otherwise 
identical between the two conditions. 

This stereotype threat manipulation is quite similar to other manipulations of 
stereotype threat- particularly those employed with children in school contexts (e.g. 
Wasserberg, 2014; McKown & Strambler, 2009). Our manipulation of stereotype threat 
involved both increasing identity salience (by asking participants to provide their race 
and describing the study as being focused on better understanding how kids like you learn 
math), and raising the stakes (by informing students that an important aim of the study 
was to see how well they performed on a test after the lesson). 

All students completed a mathematics posttest immediately following the video 
lesson. Following the posttest a subset of the students also completed measures to gather 
data on their situational interest and mathematics engagement (more detail available in 
supplementary materials). An abbreviated version of the Situational Interest Survey 
(Chen, Darst, & Pangriza, 2001) was administered to a subset of participants in both 
conditions, with test reliability leaving two measures: instant enjoyment and exploration 
intention. 

A subset of students in both conditions were also given the option to work on 
non-required math puzzles during free time after finishing the intervention video and 


posttest. 


e At Visit 3, students completed a delayed posttest and a measure of EF, the d2 test of 
attention, (Brickenkamp & Zillmer, 1998), followed by a short demographics survey. 
More detailed descriptions of these measures can be found in the supplementary 
materials. 

The research was conducted with school and the University's IRB approval. Details of the 


protocol introduction and debriefing are provided in the supplementary materials. 


Results 

Sample. Results for 135 students for whom we have complete data are included in the 
analyses reported below. Students at school 2 and at school | in year 2 (n = 79; 43 ST) also were 
administered the situational interest survey, and students at school 2 (n = 40; 21 ST) were 
administered the optional puzzles. 

Analytic Plan. We first report an analysis of pretest performance to ensure that random 
assignment was successful, and then describe analyses pertaining to our main questions of 
interest: how student EF and stereotype threat during instruction impacted learning. We examine 
this using three types of outcome measures. These measures were used to examine main effects 
on learning, as well as to test the hypothesis that high EF students would be most affected by the 
threat manipulation (with high EF students defined as those scoring above the median on the d2). 
e First, we examine immediate and sustained uptake of the misconception (subtraction) 

presented in the lesson, calculating uptake of the misconception immediately (proportion of 
problems solved with the misconception strategy at immediate posttest minus misconception 
use at pretest) and sustained over a delay (proportion of problems solved with the 


misconception strategy at delayed posttest minus at pretest). We anticipate that any gains in 


10 


use of the misconception after the lesson may indicate that the student memorized the first 
solution that was presented, without engaging in the higher order comparative processing 
within the lesson, which would have made clear that this is an invalid way to solve the 
problem. Thus misconception gains could signal that students are motivated to memorize 
everything presented in the lesson in order to be able to perform well - at the possible 
expense of the type of deep, critical engagement with comparative instruction that promotes 
enduring conceptual understanding. Additionally, if EF resources were compromised, these 
participants may have been unable to engage in that higher-level comparative thinking. 

e Second, we examine learning as defined as immediate and sustained gains in accuracy. 
Accuracy was calculated as correct set up and reasoning on a combination of procedural and 
conceptual items. Immediate learning was operationalized as accuracy gains from pretest to 
posttest, and sustained accuracy was operationalized as gains from pretest to the posttest 
administered a week after instruction. 

e Lastly, we analyzed the impact of experiencing stereotype threat during instruction on the 
extent to which students reported that they enjoyed the lesson and desired to learn more 
about the topic covered in the lesson, as well as their likelihood of actually choosing to 
engage in a non-required math activity. 

Performance at Pretest. Neither frequency of misconception use nor overall accuracy 
differed by condition at pretest (both ps > 0.5) or between high and low EF students (both p s > 
0.4). Mean misconception use and accuracy at pretest for students in the two learning conditions 
are reported in Table la. 

Effects of Stereotype Threat Manipulation Overall. In a series of regressions, EF 


(entered as a continuous variable with values ranging from 136 to 665) and Condition 
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assignment (binary coded: 0 = Control; 1 = ST) were first used to predict immediate and 
sustained changes in misconception use and content knowledge in the overall sample. Mean 
immediate and sustained gains in misconception use and accuracy for students in the Control and 
ST learning conditions are shown in Table 1a, and all results and effect sizes from the regression 
are available in Table 1b. First, experiencing stereotype threat while learning predicted 
significantly greater immediate uptake of the misconception (p = 0.009). This suggests that those 
students experiencing stereotype threat while learning may have been especially focused on 
memorizing content from the lesson at the expense of engaging in the cognitively demanding 
contrast and comparison process that promotes deep learning and conceptual change. The 
differences reduced over time, however, most likely because the misconception use of the 
Control condition increased between immediate and delayed posttest, returning to closer to 
pretest levels. Effects were less strong in the overall sample for use of the correct solutions, with 
no immediate differences in accuracy but the condition differences widened over time, revealing 
a trend to differences in sustained learning (p = 0.09). 

Student EF was positively related to immediate learning of correct content (p = 0.04) and 
somewhat greater (p = 0.09) sustained gains for correct content, indicating that EF may play an 


important role in learning from this lesson, and that high EF participants learned more overall. 


EF Variations in Effects of Stereotype Threat Manipulation. While there were some 
relations between condition and EF on learning for the full sample of participants, we next 
investigated the prediction from the testing literature, that the effects of stereotype threat are 


highest for high EF individuals. Condition assignment was used to predict immediate and 
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sustained changes in misconception use and content knowledge among high and low EF students 
separately. All results and effect sizes from the regressions are available in Table 2, and mean 
immediate and sustained changes in misconception use and accuracy for high and low EF 


students in the Control and ST learning conditions are shown in Figure 1a and b. 


Figure | about here 


As shown in Table 2, among high EF students, experiencing stereotype threat while 
learning predicted greater immediate and sustained uptake of the misconception, and smaller 
sustained gains in correct content, with much larger effect sizes than when considering the 
sample as a whole. In contrast, for low EF students, learning condition did not impact immediate 


or sustained gains in either correct content or misconception use. 


Table 2 about here 


Posthoc analyses revealed that statistically significant results all had above .75 observed 
Statistical power to detect effects, with the exception of sustained gains in the high EF group 
(.60). Nonsignificant results had smaller r2s and thereby were underpowered to detect 
relationships, so Type IJ errors of unidentified effects were possible. 

Student Attitudes. In order to better understand how stereotype threat during learning 
impacted students’ subjective experience of the lesson and likelihood of choosing to engage in a 


non-required math activity, we compared students’ responses to the exploration intention and 
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instant enjoyment subscales of the situational interest survey and number of optional math 
puzzles completed in the 2 conditions. 

We first examined whether these subscales were related to learning. Exploration intention 
was related to student learning, with those students who reported greater desire to learn more 
about the topic showing significantly greater overall gains in accuracy, 7(79) = 0.22, p < 0.05. In 
contrast, instant enjoyment did not predict overall gains in accuracy, (79) = 0.22, p = 0.48. 

We next assessed relations to the manipulation. A one-way ANOVA revealed that 
students in the ST condition reported both significantly less enjoyment than students in the 
Control condition, (Mean Control: 4.01(0.16); ST: 3.43 (0.19), F (1,77) = 5.22, p = 0.03; partial 
72 = 0.063; observed power = 0.616), and less exploration intention (Mean Control: 3.76 (0.18); 
ST: 3.25 (0.18), F (1,77) = 4.01, p = 0.05; partial n2 = 0.048; observed power = 0.496). These 
differences in students’ experience of the lesson are striking because they emerged immediately 
after the first posttest, when performance did not yet systematically differ across conditions. 
Moreover, students who had experienced stereotype threat during instruction were less likely to 
chose to engage in optional math activities after the intervention, attempting significantly fewer 
math puzzles than students who had not experienced stereotype threat during instruction (Mean 
Control: 3.47 (0.30); ST: 2.29 (0.43), F (1,38) = 5.00, p = 0.03; partial n2= 0.116; observed 
power = 0.587). 

Discussion and Conclusions 

These data provide the first evidence that stereotype threat during conceptually 
demanding instruction can harm mathematics attitudes and learning. Increasing the salience of 
race in the context of an evaluative introductory prompt led to increased misconceptions and 


decreased retention for the conceptual content — particularly among high EF students, who 
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otherwise benefited most from this type of instruction. Overall, EF facilitated learning, 
predicting greater gains from the lesson. However, stereotype threat had a greater detrimental 
impact on learning among high EF students. Low EF students learned less regardless of learning 
condition, while greater between-condition differences were found for high EF students. 

Two primary, non-exclusive, mechanisms could explain these results, and both receive 
some support in the current study. First, it is possible that worry ideation based on a fear of 
confirming negative stereotypes compromised participants’ EF capacity during instruction. With 
reduced EF available for high EF students accustomed to engaging these resources in the sorts of 
abstract mathematical thinking intended during this lesson, these typically higher performing, 
high EF students suffered the most. This is consistent with much research on pressure, anxiety 
and stereotype threat, which shows the largest effects for high EF or working memory 
individuals (for reviews, see Beilock, 2008; Maloney, Sattizahn, & Beilock, 2014). 
Compounding these direct impacts on learning, stereotype threat during instruction decreased 
students’ enjoyment of the lesson and desire to learn more about the lesson’s content, among 
both high and low EF students, which could have long-range impacts on STEM career goals and 
persistence. 

A second possible contributory explanation for the results was that students who were 
administered the experimental prompt reported less interest and enjoyment in the mathematics. 
Additionally, these participants made the choice to spend less time on optional math puzzles. 
These findings suggest that students who experienced stereotype threat during instruction may 
have been less likely to think about content from the lesson between sessions or make 
connections with topics covered during their math classes, leading to worse consolidation of 


learning and resulting in the lower performance. These data were limited since they were not 
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collected from all participants, but they suggest the potential importance of this pathway 
impacting both children's learning and engagement in mathematics. 

This pathway received some support, as exploration intention predicted student learning, 
although enjoyment did not. This suggests that differences in exploration intention resulting from 
experiences of stereotype threat during learning may have contributed to between-condition 
learning differences, but that differences in enjoyment likely did not. However, even though 
within the boundaries of this experiment, decreased enjoyment among students who experienced 
stereotype threat during instruction likely did not drive between-condition learning differences, 
decreased enjoyment in the face of stereotype threat may have important long-term implications, 
possibly impacting career goals and leading to less persistence in the content domain. This 
mechanism is crucial to consider, because it suggests ways that perceptions of stereotype threat 
could have long-term implications for student engagement with a domain of knowledge, such as 
mathematics. 

This work is a first step in understanding the phenomenon of stereotype threat during 
higher order thinking and learning, and raises the possibility that subtle threats could be 
contributing to real and persistent achievement gaps by race, ethnicity, and gender. Importantly, 
whereas the effects of stereotype threat during testing are immediate but temporary and do not 
affect the knowledge base from which children progressively build new understandings, the 
effects of stereotype threat during instruction persist even when the threat is no longer present 
and are cumulative, as learning is built on a foundation of prior knowledge. If experiences of 
stereotype threat prevent students from fully benefitting from instruction at one time point, in a 
discipline such as mathematics that builds sequentially, subsequent learning opportunities may 


also be affected, leading to students falling farther and farther behind. Additionally, feelings of 
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performance pressure due to stereotype threats could also lead to disengagement, reduced 
interest and experience seeking in domains in which these threats are perceived. 

As stereotype threat can be induced with very little prompting, (McKown & Strambler, 
2009), students from academically stereotyped groups may be experiencing it during instruction 
on a regular basis and the cumulative effect on learning could be even more damaging than 
underperformance on tests. Future research into what elicits stereotype threat during learning 
opportunities, for whom, and how often it occurs, will be vital for understanding how to guard 
against and ameliorate the effects of stereotype threat in the classroom, for both testing and 
learning opportunities. 
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Table la. Immediate and Sustained Changes in Use of the Misconception and Accuracy for 
Students in the Control and ST Learning Conditions 
Pretest Means (SE) Immediate Gains (SE) Sustained Gains (SE) 


Misconception Accuracy Misconception Accuracy Misconception Accuracy 


Control 0.46 (.06) 0.15 (.02) -0.11 (.04) 0.18 (.03) -0.01 (.05) 0.14 (.03) 


n= 64 
ST 0.42 (.06) 0.14 (.02) 0.05 (.05) 0.16 (.03) 0.08 (.04) 0.08 (.03) 
n=7\1 


Table Ib: Contributions of EF and Learning Condition to Immediate and Sustained Changes in 


Misconception Use and Accuracy 
Change from Pretest r2 Dp EF Dp Condition Dp 


B standardized B standardized 


Immediate Misconception | .064 .014 -.132 126 227 .009 


Accuracy .036*  .093 182 .038 -.074 397 
One Week Misconception | .023  .223 -.105 .230 119 .176 
Delay Accuracy 039% = .076 154 .086 -.143 .100 


DF for all analyses (2,129) 
ap<.10 


Table 2. Impact of Stereotype Threat during instruction on Immediate and Sustained Changes in 


Misconception Use and Accuracy from Pretest anong High vs. Low EF Students 


r2 Model p Condition Condition 
Bstandardized 

High EF Immediate  Misconception Use | 0.096 0.011 0.310 0.011 
Students Accuracy 0.015 0.329 -0.122 0.329 
Sustained  Misconception Use |0.109 0.007 0.331 0.007 

Accuracy 0.069 0.033 -0.263 0.033 

Low EF — Immediate  Misconception Use |0.018 0.284 0.134 0.284 
Students Accuracy 0.000 0.977 0.004 0.977 
Sustained  Misconception Use |0.008 0.488 -0.087 0.488 

Accuracy 0.000 0.975 0.004 0.975 


+Model degrees of freedom (1,64) 


Zo 


Figure Caption Page 


Figure 1 Immediate and Sustained Changes in Misconception Use (la) and Accuracy (1b) for 


High vs. Low EF Students in the Control and ST Learning Conditions 
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